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Abstract 


In  this  paper*  ve  describe  a  class  of  optimal  block  diagonal 
scalings  (preconditionings)  of  a  symmetric  positive  definite 
block  2-cyclic  matrix*  generalising  a  result  of  Forsythe  and 
Strauss  [1]  for  (point)  2-cyclic  matrices. 
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1.  Introduction 


Let  A  be  an  n  *  n  symmetric  positive  definite  matrix  and  let  A  be  a 

class  of  n  x  n  nonsingular  matrices.  In  this  paper*  we  consider  the 

problem  of  finding  an  E  e  A  which  minimizes  the  condition  number 

„  a. (EtAE) 

K(EtAE)  =  ----- - 

a  (ECAE) 
n 

of  the  scaled  (preconditioned)  matrix  EtAE  (here  ^(E^AE)  and  o  (EtAE) 

i  n 

denote  respectively  the  largest  and  smallest  eigenvalues  of  EtAE),  In 
particular*  we  describe  a  class  of  optimal  block  diagonal  scalings 
(preconditionings)  of  a  block  2-cylic  matrix*  generalizing  a  result  of 
Forsythe  and  Strauss  [1]  that  a  (point)  2-cyclic  matrix  is  optimally 
conditioned  with  respect  to  the  class  of  positive  diagonal  matrices  if  all 
the  elements  of  the  diagonal  are  equal* 


2.  Optimal  2x2  Block  Diagonal  Scaling 


Let  A  be  an  n  x  n  symmetric  positive  definite  matrix.  Then*  for  any 
0  <  m  <  n*  A  can  be  written  as  a  2  x  2  block  matrix 


2 


L 


Let  A(m*n-m)  denote  the  set  of  ell  nonsinguler  2*2  block  diagonal 
matrices  of  the  form 


E 


0 


vhere  Ej  is  m  *  m  and  E2  is  n-m  *  n-m. 
class  of  optimal  scalings  E  e  A(m*n-m) 


The  following  result  describes  a 
for  A. 


Theorem  1:  If  1  e  A(m*n-m)  and  EEfc  =  cD  1  for  some  positive  constant  c, 
then 

K(EtAE)  =  min  {K(EtAE)  |  E  €  A(m.n-m)}  . 


Proof : 

Let  S  = 


I  0 
m 

0  -I 


n-m 


where  1^  denotes  the  k  *  k  identity  matrix.  Then 


2D- A 


D1  ~C 
-C  D, 


I  0 
0  -I 


n-m 


D1  C‘ 
C  D, 


I  0 
m 

0  -I 


n-m 


=  SCAS. 


(1) 


Let  E  €  A(m»n-m).  Since  E  is  nonsingular*  EtAE  is  symmetric  positive 
definite  so  that*  by  the  Rayleigh  principle* 

ytEtAEy  S  Oj^AE)  yly  for  all  y  £  Rn  (2) 

and 

ytEtAEy  i  0Q(EtAE)  y*y  for  all  y  €  Rn.  (3) 

By  (1)»  the  fact  that  SE  =  ES*  and  (2)* 

ytEt(2D-A)Ey  =  ytEtStA8Ey  =  ytStEtAESy  S  a^(EtAE)  yVsy 

so  that*  since  8t8  *  I  * 

n 

ytEt(2D-A)Ey  S  a^(EtAE)  y*y  for  all  y  c  R°.  (4) 
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Similarly •  using  (3)  instead  of  (2)» 


ytEt(2D-A)Ey  k  on(EtAE)  yfcy 


for  all  y  c  R  . 


Adding  o  (EtAE)  times  (2)  to  -a.(EtAE)  times  (5). 
n  i 

(«1(EtAE)  +  on(EtAE)}  ytEtAEy  -  20j(EtAE)  y^DEy  S  0 


so  that 


,  t  2® ,(E  AE) 

yEAEy  S  - - - - - ytEtDEy  for  all  y  e  R. 

o, (ECAE)+o  (ECAE) 
l  n 

Similarly*  adding  aj(EtAE)  times  (3)  to  -aji(EtAE)  times  (4)* 

Uj^AE)  +  an(EtAE) }  ytEtAEy  -  2on(EtAE)  y^DEy  k  0 

so  that 


ytEtAEy  k 


2a  (E^AE) 

■r-5 . ; —  ytEtDEy 


a, (EtAE)+a  (EtAE) 

1  R 


for  all  y  €  R 


Nov  let  E  c  A(m»n-m)  with  EE  =  cD  for  some  positive  constant  c. 
Since  E  is  nonsingular »  taking  y  =  E  *Ex  in  (6)» 


xcEcAEx  S 


2«  (ECAE)  _ 

. . r—  x  EcDEx 

#.(B  AE)+«  (EtAE) 
i  n 


for  all  x  €  R  • 


ECDE  =  E  {cE  E  }  E  =  cl 


so  that 


x^AEx  i 


2co-(E  AE) 

— r - — r - Jt  x 


aAitM)*a  (EtAE) 
i  n 


for  all  x  t  R  . 


Similarly*  using  (7)  instead  of  (6)* 
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I 


_  _  2co  (ECAE) 

x^AEx  i  . . .  xlx  for  #11  x  e  Rn.  (9) 

a.U'AEj+a  (E  AE) 

1  tl 


Therefore*  by  the  Rayleigh  principle* 

2con(EtAE)  ^  2co.(EtAE) 

. . S  «  < EtAE)  S  a.(EAE)  S  . . 

o,(EcAE)+o  (ECAE)  n  1  a. (EcAE)+a  (ECAE) 

An  An 


so  that 


^  o  (ECAE) 

K(EtAE)  = 

o  (E  AE) 

XL 


2co.(EtAE)  /  2c«  (EtAE) 

- 1 -  /  - 5 - 

a.^AEj+o  (ElAE)  '  a.  (EtAE)+o  (EtAE) 
An  in 


o. (EtAE) 

=  ------  =  K(EAE)  . 

a  (ECAE) 
n 

QED 


Note  that  if  E  c  A(m*n-m)  satisfies  the  conditions  of  Theorem  1*  then 

cl  E^C^E 
m 

E  CE  cl 

n-m 

and  the  diagonal  blocks  of  EtAE  are  common  multiples  of  the  identity 
matrix.  Therefore: 


Corollary  2:  If  D  =  cIQ  for  some  positive  constant  c»  then  A  is  optimally 
conditioned  with  respect  to  A(m»n-m). 


However*  not  all  optimal  scalings  E  e  A(m.n-m)  of  A  satisfy  Theorem  1. 


For  example*  the  matrix 


A  = 


5 


pOO 
0  2  1 
0  1  2 

is  optimally  conditioned  with  respect  to  A(2.1)  for  1  £  p  £  3  (cf.  Forsythe 
and  Strauss  [13). 

3.  Optimal  Block  Diagonal  Scaling  of  Block  2-Cyclic  Matrices 

Let  A  be  a  symmetric  positive  definite  block  2-cyclic  matrix.  Then* 
vithout  loss  of  generality  (by  symmetrically  permuting  the  rows  and 
columns)*  A  can  be  written  as  a  t  x  t  block  matrix  of  the  form 


where  is  n^  *  n^  and  C  ii  m  >  n-m  with  m  =  n^  +  nj  +  ...  +  nr  “id 
n  !  Bj  ♦  +  ...  ♦  n^.  Moreover*  the  block  diagonal  matrix 


is  again  symmetric  positive  definite  and  hence  nonsingular. 


6 


Extending  the  previous  definition*  let  A(n2»n2«...tnc)  denote  the  set 
of  ell  nonsingular  t  *  t  block  diagonal  matrices  of  the  form 

Ej  0  ...  0 

0  e2  . . .  0 

•  •  e 

•  •  e 

•  •  • 

0  0  . . .  Et 

where  E^  is  n^  x  .  The  following  result  characterizes  a  class  of  optimal 
scalings  E  €  A(n2»n2 . nfc)  for  A. 

Corollary  If  E  £  A(uj  ,n2>...,nt)  and  EE1  *  cD  *  for  some  positive 
constant  c»  then 

Jtfi^AE)  =  min  {K(EtAE)  |  E  €  A(n2 »n2*.. . ,nt) } 

=  min  {KCE^AE)  I  E  e  A(m.n-m)}  . 

Therefore*  if  D  =  cIq  for  some  positive  constant  c*  then  A  is  optimally 
conditioned  with  respect  to  both  and  A(m,n-m) • 

Proof  s 

Since  E  e  Mn^  #nt)  c  A(m#n-m) »  the  result  follows  immediately 

from  Theorem  1  and  Corollary  2« 

QED 


Forsythe  and  Strauss  [1]  proved  that  a  (point)  2-cyclic  matrix  is 
optimally  conditioned  with  respect  to  the  class  of  all  positive  diagonal 
matrices  if  the  diagonal  entries  are  all  equal*^  This  is  the  special  case 


An  alternate  proof  is  given  in  Young  [2]. 


n.  =  1  of  Corollary  3.  However*  as  the  Corollary  also  shows*  such  a  matrix 
is  optimally  conditioned  with  respect  to  the  much  larger  class  A(m*n-m)  of 
2x2  block  diagonal  matrices. 
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